Papers with reasoning procedure
Entropy-based Exploration Conduction for Multi-step Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to automatically decide the depth of exploration of the reasoning procedure lead to high cost and a lack of flexibility. |
| Approach: | They propose a method that dynamically adjusts the exploration depth during multi-step reasoning by monitoring LLM’s output entropy and variance entropic. |
| Outcome: | The proposed method captures the uncertainty of the current step and the fluctuation of uncertainty across consecutive reasoning steps and then selects whether to deepen, expand, or stop exploration according to the probability. |
Reinforced Dynamic Reasoning for Conversational Question Generation (P19-1)
Copied to clipboard
| Challenge: | Empirical results on the recently released CoQA dataset demonstrate the effectiveness of our method . large-scale highquality conversational question answering datasets such as CoQA and QuAC can help train models to answer sequential questions. |
| Approach: | They propose a task called Conversational Question Generation which generates a question based on a passage and a conversation history to generate the next question. |
| Outcome: | The proposed method is based on a question-answering style conversation dataset . it can be used to generate meaningful questions on QA and SQuAD datasets . |
Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing Knowledge Graph Question Answering (KGQA) methods focus on answering factual questions, leaving questions involving commonsense reasoning unaddressed. |
| Approach: | They propose a commonsense KGQA methodology that axiomatically surfaces commonsensical knowledge of Large Language Models and grounding every factual reasoning step on KG triples. |
| Outcome: | The proposed method outperforms existing methods and reduces instances of hallucination and reasoning errors. |
Verifiable, Debuggable, and Repairable Commonsense Logical Reasoning via LLM-based Theory Resolution (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have led to substantial interest in their application to commonsense reasoning tasks. |
| Approach: | They propose a logical reasoning framework that integrates commonsense knowledge with a verifiable logical framework that mitigates hallucinations and facilitates debugging. |
| Outcome: | The proposed framework improves on three language-based reasoning tasks and improves accuracy and reasoning correctness. |